arXiv:1506.02568v2 [cs.IT] 12Jun2015 


Deterministic Construction of RIP Matrices in 
Compressed Sensing from Constant Weight Codes 

Liqing Xu and Hao Chen * 

June 15, 2015 


Abstract 

The expicit restricted isometry property (RIP) measurement matrices 
are needed in practical application of compressed sensing in signal process¬ 
ing. RIP matrices from Reed-Solomon codes, BCH codes, orthogonal codes, 
expander graphs have been proposed and analysised. On the other hand 
binary constant weight codes have been studied for many years and many 
optimal or near-optimal small weight and ditance constant weight codes 
have been determined. In this paper we propose a new deterministic con¬ 
struction of RIP measurement matrices in compressed sensing from binary 
and ternary contant weight codes. The sparse orders and the number of 
budged rows in the new constant-weight-code-based RIP matrices can be 
arbitrary. These contant-weight-code based RIP matrices have better pa¬ 
rameters compared with the DeVore RIP matrices when the sizes are small. 

Index Terms. Compressed sensing, Restricted isometry property, con¬ 
stant weight code, coherence 

MSC 2010: 94A15, 94BXX 

1 Introduction 

Compressed sensing was proposed by E. J. Candes, J. Romberg, T. Tao, 
and D. Donoho in 2006 for efficient sampling of sparse signals and has been 
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found vast applications in signal processing. It is a technique that recovers a 
sparse signal x £ R A from the measurement y = • x which has k non-zero 

coordinates at sampling rates that are substantially much lower than the 
Nyquits-Shannon rate ([3 0 0 [Ml [18l [121 E3])- For n budged rows and 
sampling fc-sparse signals x in {N columns, n < N ), the measurement 
is y = $ • x, where x £ R A is a vector with only at most k non-zero co¬ 
ordinates, $ is a size n x N measurement matrix. Effective algorithms to 
recover x from y have been proposed in mmm- We say that a matrix 
$ satisfies the restricted isometry property (RIP) of order k with the con¬ 
stant 6^ satisfying 0 < 6k < 1, if for every fc-sparse vector (that is, only k 
coordinates of the signal are non-zero) x £ R ,v , 1 — 6k < < 1 + 5k- 

The RIP of the measurement matrix $ guarantees the effective recovery of 
the A:-sparse signal x £ R A from y = $ • x ([2, 7j) y i a linear programming. 
Though it has been shown that random matrices satisfy the RIP with high 
probability, in practice the sampling has to be done deterministically. 

For a n x N matrix $ with N columns (f>i ,...., (j)N, the coherence is 

= rna/Xi^j ||0^lj^ > || • Then > yj n ^_ n -j from the Welch bound. It is 
proved in [31 [9] that a matrix $ with the coherence /i^ satisfies the RIP 
with the sparsity order k < + 1. Thus it is desirable to give explicit 

construction of matrices with small coherence in compressed sensing. 

The first systematic deterministic construction of RIP matrices is due to 
R. DeVore m R. Calderbank and B. Hassibi and their collaborators gave 
many deterministic constructions of RIP (or statistical isometry property) 
matricse in [2j [231 !SJ • In 2011 J. Bourgain, S. Dilworth, K.Ford, S. Konya- 
gin and D. Kutzarova [3j gave explicit RIP matrices satisfying n = o(k 2 ) 
where n is the row size and k is the sparse order, from new estimates about 
exponential sums and additive combinatorics. There have been many ex¬ 
plicit constructions of RIP matrices from various mathematical objects such 
as chirp sensing codes (12), bch codes (IB), Reed-Muller codes ( 1221), 
orthogonal codes (EH), Reed-Solomon codes m) and expander graphs 
(pH). However in these previous constructions, the sizes of the RIP matri¬ 
ces are restricted. This is not desirable in the practical application. 

A binary contant weight ( n , d , w) code is a set of vectors in F2 such that 
1) every condword is a vector of Hamming weight w and 2) the Hamming dis¬ 
tance wt(x — y) of any two codewords x and y is at least d. Binary constant 
weight codes have important applications in various information processing 
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problems mmmm)- To determine the maximal size A(n, d, w) of a 
(n, d, w) code is a classicla problem in coding theory and has been studied 
by many authors mmmm)- For small n, d, w, we refer to [32] for the 
present best known lower bounds for A(n, d, w). The following Gilbert type 
bound ([251) and Graham-Sloane lower bound are the most known lower 
bounds for A(n, 2 d, w). 


Theorem 1.1 (Gilbert type lower bound ). A(n,2d,w) > - 

v-\cZ— 1 

^i =0 

Theorem 1.2 (Graham-Sloane bound). Let q be the smallest prime 
power satisfying q >n then A(n, 2d , w) > ^rr 

However the binary constant weight codes in Gilbert type lower bound 
and Graham-Sloane lower bound were not explicitly given. One has to search 
at least q d such codes to find the desired one in the Graham-Sloane lower 
bound (see m, page 38). 




A ternary constant weight (n, d, w) code is a set of vectors Fg such that 
1) every condword is a vector of Hamming weight w and 2) the Hamming 
distance wt(x — y) of any two codewords x and y is at least d. The maximal 
size As(n, d, w) of a (n, d, w) ternary constant weight code have the following 
Gilbert lower bound ( [1511271. 28]). 


Theorem 1.3 (Gilbert type lower bound) A^(n,d,w) > 


7 o n i w 

WflCTC o d ^ 


■s^d—ls^min{[i/2\,n—w} 
^*=0 2 -‘j =0 





2 j . 



In this paper we give a general constructions of explicit RIP matrices 
with small coherence from general binary and ternary constant weight codes. 
The resulted RIP matrices will be compared with RIP matrices from pervi¬ 
ous constructions. A general analysis will be given in section 4. 
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2 Construction 


In this section we prove the following result. 

Theorem 2.1. We have anx A(n, d, w ) i?IP matrix with the coherence 
P — 1 — hi¬ 
proof. For a size A(n, d, w ) binary constant weight code, we just use 
its codewords as the column vectors of a n x ^4(n, d, w ) matrix. Since the 
intersection of the supports of any two columns has at most iv — | positions, 
the conclusion follows directly. 

Corollary 2.1. We have anx A(n, 2w — 2,2) RIP matrix with coher¬ 
ence n < 


±1 randomized constant-weight-code-based RIP matrices. 

If we use ±l’s in the supports of the codewirds of a binary constant 
weight codes to construct RIP matrices, it is obvious the RIP matrices 
would have the same size and the coherence of these ±l-randomized RIP 
matrice are still upper bounded by 1 — 

In the following construction we take the identification F 3 = {0,1,-1}. 
Then a codeword in a ternary constant weight code can be identified with 
a vector in R 3 with coordinates 0 , 1 , — 1 . 

Theorem 2.2. We have anx A${n, d, w) RIP matrix with the coherence 
M<1 

Proof. For any two codewords ci and C 2 in a ternary constant weight 
(n, d, w) code we have d = 2w — 2\supp(c\) D supp( C 2 )| + D where D is the 
number of positions in supp( ci) D supp( C 2 ) where the products of the coor¬ 
dinates of ci and C 2 are —1. Then < ci,C 2 >= \supp(ci)r\supp(c 2 )\ — 2D = 
w ~ <vo — |. It is clear ||c|| 2 = w for each codeword in this ternary 

constant weight code. The coclusion follows directly. 
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3 Examples from some best known constant weight 
codes 

The basic construction of m is as follows. For a polynomial / with de¬ 
gree less than or equal to r — 1 in F p [x] where F p is a finite field with 
p elements (here p is a prime number, it can also be used for finite field 
with q = p f ' elements), the length p 2 vector Vf = (/( a ,b)) is determined by 
its p 2 coordinates f( a ,b) f° r (o, 6 ) G F p x F p . Here fi a ,b) = 0 if /(a) / b, 
f(a,b) = 1 if /(a) = b. Then the p r columns of these lenght p 2 vectors give 
a p 2 x p r matrix. It was proved in [4] that the coherence of this p 2 x p r 
matrix D satisfies that pn < r -^-- In the trivial case r = 2 the RIP matrix 
from DeVore construction is of size p 2 xp 2 and p = | for these prime powers. 

It is well-known A(q 2 ,2(q — 1 ),q) = q 2 + q, we have q 2 X ( q 2 + q) RIP 

matrix with the coherence -. This is better than the RIP matrices from 

<? 

DeVore construction. However q 2 x q 3 RIP matrix with the coherence - was 

H H Q 

constructed in j25] for each prime power q. 

For the best known binary constant weight codes with small parameters 
n,d,w we refer [32J. From Theorem 2.1 we list some explicit RIP matrices 
from constant weight codes. 
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Table Explicit RIP matrices from constant weight codes 


RIP matrices fj,, n, m 

constant weight codes 

K®) < £,40,45 

.4(40,10,6) > 45 

K®) < ^5 42, 55 

.4(42,10,6) > 55 

M*) < 1)45,57 

.4(45,10,6) > 57 

»(*) < £,47,63 

.4(47,10,6) > 63 

M*) < 50, 72 

.4(50,10,6) > 72 

Vi*) < 1,51,76 

.4(51,10,6) > 76 

M*) < 55,87 

.4(55,10,6) > 87 

< 1,56,91 

.4(56,10,6) > 91 

W) < 1 61, HI 

.4(61,10, 6) > 111 

/i($) < 4,63,126 

.4(63,10,6) > 126 

M$) < 4,49,56 

.4(49,12, 7) > 56 

/i($) < i,55,63 

.4(55,12,7) > 63 

M*) < 1,56,71 

.4(56,12,7) > 71 

M*) < 4,61,72 

.4(61,12,7) > 72 

M*) < 4 , 62, 79 

.4(62,12,7) > 79 

f 64,88 

.4(64,12, 7) > 88 

K®) < £,64,72 

.4(64,14,8) > 72 

m(4>) < £,71,80 

.4(71,14,8) > 80 

< £, 72,89 

.4(72,14,8) > 89 

K$) < 4,81,90 

.4(81,16,9) > 90 


3.1 Subspace codes 

A constant dimensional subspace [n, d, k] q code is a family of k dimensional 
subspace in F” such that the distance d(U, V) = 2k — 2dim(JJ D V) > d sat¬ 
isfied. In a recent paper [19] of T. Etzion and A. Vardy constructed binary 
constant weight codes from constant dimension subspace codes. From their 
result A(2? m ~ 1 ,2 m+1 — 4,2 m ) = 2 2m_1 + 2 m ~ 1 is proved. Thus we have a 
2 2m_ i x (2 2m_1 + 2 m_1 ) RIP matrix with the coherence fi < 2 , n 1 _ 1 . From 

Theorem 2 in this paper we have a q tk x ■ q qk Z[ RIP matrix with 

the coherence /r < (page 3 of the paper). In genral we get the follow 
construction of RIP matrices from constant dimension subspace codes. 

Theorem 3.1. If C is an [n,d = 2t,k\ q constant dimension code then 
there exist a (q n — 1,2 q k — 2q k ~ t ,q k — 1 ) binary constant weight code of 
size \C\ and a ( q n — 1,2 q k — 2q k ~ t ,q k ) binary constant weight code of size 
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(q n k 1 )|C|. Thues we have ( q n — 1) x \C\ RIP matrix with the coherence 
p < q q kSi an d (<?" — 1) x (q n ~ k ~ 1 )\C\ RIP matrix with the coherence p < Jj. 

3.2 Steiner systems 

A Steiner system S(t,w,n ) is a collection B of ic-subsets taken from an 
n-set V such that each i-subset of V is contained in exactly one element of 
B. The close relation of Steiner systems with binary constant weight codes 
was indicated in [26]. However the existence of the Steiner system for t > 6 
is a difficult and long-standing problem in mathematics ([3D])- 

Corollary 3.1. If there exists a Steiner system S(t,w,n), we have a 
n x ( n (" i)--(/i-t+i) £,jp ma f r i x .yjifa coherence p < There exists a 
constant uq(w) for any given positive integer w such that for any n > no(vj) 
satisfying n — 1 = 0 mod w — 1 and n(n — 1) = 0 mod w(w — 1), we have a 
n x ftjp ma t r i x w Hh the coherence /./ < p. 

Proof. From a Steiner system S(t, w, n ) a binary constant weight (n, 2{w— 
t + 1), w) can be constructed ([26]). On the other hand we use the famous 
asmptotical existence result of R. M. Wilson ([30]) to get the sencond con- 
slusion. 


4 General analysis 

One of the advantage of constant-weight-code-based RIP matrice is that 
their sizes can be arbitray. 

Theorem 4.1. For any number n of budged rows and any given sparse 

order k we can recover the k-sparse signals in N = [ - 

dimensional real space by using the constant-weight-code-based RIP ma¬ 
trix with the coherence p, < j . Here t can be arbitrary positive integer. 

The following result follows from the Graham-Sloane lower bound and 
Theorem 2.1 directly. 
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Theorem 4.2. For any number n of budged rows and any given sparse 

h 

r \ kt n 

order k we can recover the k-sparse signals in N = ] dimensional 

real space by using the constant-weight-code-based RIP matrix with the 
coherence /j < Here t can be arbitrary positive integer. 

Similarly we have the following result from the Gilbert type lower bound 
for ternary constant weight codes. 


Theorem 4.3. For any number n of budged rows and any given sparse 


n 
kt, 


• 2 


kt 


order k we can recover the k-sparse signals in N = [ - ], where 


Qn,kt _ 


_ ^2(k—l)t— 1 ^min{[i/2],n—kt} (kt\ fn kt\ (kt j 


J 2(k — l)t — l 


l 

j=0 


\i. 


j 


i ~ 2 j 


. 2 J , dimensional 


real space R A by using the ternary-constant-weight-code-based RIP matrix 
with the coherence n < 1. Here t can be arbitrary positive integer. 


5 Summary 

Explicit RIP measurement matrices are needed in practical application of 
compressed sensing to signal processing. In this paper general method of 
contructing explicit RIP matrices from binary and ternary constant weight 
codes is presented. Thus explicit RIP matrices in compresed sensing can 
be constructed from constant subspace codes and Steiner systems. The 
constant-weight-code-basd RIP measurement matrices can be used to sam¬ 
ple arbitrary sparse-order signals with arbitrary number of budged rows in 
some Euclid spaces with suitable dimensions. The RIP matrice from small 
binary constant weight codes seem to be useful in practice. 
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